PATENT APPLICATION 
DOCKET NO. P16100US1 



Method and Gateway GPRS Support Node (GGSN) for Control Plane 

Redundancy 

5 BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to GPRS networks, and in particular to a 
Gateway GPRS Support Node (GGSN). 

10 

Description of the Related Art 

General Packet Radio Services (GPRS) is a packet-based wireless 
communication service that offers higher data rates and continuous connection to 
an Internet Protocol (IP) data network for mobile phone and computer users. The 

15 higher data rates allow users to take part in videoconferences and interact with 
multimedia Web sites and similar applications using mobile terminal devices as 
well as notebook computers. GPRS is an evolution of the Global System for 
Mobile (GSM) communications and complements existing services such as the 
circuit-switched cellular phone connections and the Short Message Service 

20 (SMS). 

In GPRS packet-based service communication channels are used on a 
shared-use, as-packets-are-needed basis rather than dedicated only to one user at a 
time. As GPRS becomes available, mobile users of a Virtual Private Network 
(VPN) are able to access privates network continuously rather than through a dial- 
25 up connection. GPRS also complements Bluetooth, a standard for replacing wired 
connections between devices with wireless radio connections. GPRS is an 
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evolutionary step toward the Third Generation (3G) Enhanced Data GSM 
Environment (EDGE) and Universal Mobile Telephone Service (UMTS). 

Reference is now made to Figure 1 (Prior Art), which shows a high-level 
logical architecture diagram of a typical GPRS network 100, with the standard 
5 accepted nodes, functionalities and interfaces. The functioning of the illustrated 
network is known in the art, as described in the Third Generation Partnership 
Project (3GPP)' GPRS standards Release 99, herein included by reference. For 
example, shown in Figure 1 is a Serving GPRS Support Node (SGSN) 102 that 
provides the direct access point for GPRS-based terminals, subtending from one 

10 or more Gateway GPRS Support Nodes (GGSNs) 104i, that provide the gateway 
to the SGSN across mobile networks that the user may visit. The GGSNs 104i are 
one of the key components of GPRS core network, being the anchor points for the 
mobile GPRS terminals to which they provide support for seamless IP 
connectivity. The GGSNs support access for the Mobile Stations (MS) towards 

15 multiple Packet-Data networks (PDN), such as for corporate/ISPs (Internet 
Service Providers) 108, by using Virtual Private Network (VPN) technologies. 
Corporate/ISP selection by the MS, utilise the Access Point Name (APN) 
information element to create GPRS Tunnelling Protocol (GTP) message such as 
defined in the Third Generation Partnership Project (3GPP) Technical 

20 Specification (TS) 29.060 of Release 99, and in the GSM 09.60 of same Release 
99, both of which are herein included by reference, in the setting up of sessions 
through the GPRS network. The communications between the MS 106 and the 
GGSN 104 are connection oriented and hence continuous support of a GTP data 
session in the GGSN is of utmost importance for the user's service acceptance. 

25 The GGSN receives IP datagranas routed to the Packet Data Protocol (PDP) 
address of any of its connected MSs, and tunnels those IP datagrams for deUvery 
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to the MS via the GTP tunnel (i.e. through the SGSN). The GGSN is connected to 
the SGSN via an IP backbone. 

Therefore, the availability of the GGSN is critical for the continuous 
provision of data services in the GPRS network. However, the existing platforms 
on which the GGSN functionality is implemented do not provide platform 
redundancy. Consequently, in current GGSN implementations, in case of failure 
of a software module, or of a hardware component of the GGSN, the 
GPRS/UMTS service is interrupted until the failed GGSN recovers. 

Accordingly, it would be advantageous to have a GGSN having a 
distributed architecture allowing a control plane redundancy that avoids the total 
collapse of the GGSN in case a given hardware or software component of the 
GGSN experiences a failure. The present invention provides such a method and 
system. 

SUMMARY OF THE INVENTION 

In one aspect, the present invention is a method for replacing a failed data 
session slave control unit (GTP-C/s) in a Gateway General Packet Radio Service 
(GPRS) Support Node (GGSN), the method comprising the steps of: 

detecting a failure or a shutdown of the GTP-C/s in the GGSN; 

detecting if the failed GTP-C/s controlled any data sessions before it 

failed; 

if the failed GTP-C/s controlled any data sessions before it failed, closing 
all the data sessions and accounting sessions related to the data sessions. 

In another aspect, the present invention is a method for replacing a failed 
data session master control unit (GTP-C/m) in a Gateway General Packet Radio 
Service (GPRS) Support Node (GGSN), the method comprising the steps of: 

detecting a failure or a shutdown of the GTP-C/m in the GGSN; 
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detecting, among all remaining data session control units (GTP-C) 
available in the GGSN, the GTP-C with the least load, and electing the GTP-C 
with the least load as a fail-over unit for the GTP-C/m that failed; 

recovering by the elected GTP-C information related to the failed GTP- 
C/m from other GTP-C units; 

rebuilding by the elected GTP-C a GTP-C/m information database using 
the information related to the failed GTP-C/m; and 

starting the elected GTP-C as a GTP-C/m of the GGSN, 

In yet another aspect, the present invention is a Gateway General Packet 
Radio Service (GPRS) Support Node (GGSN), comprising: 

a plurality of slave data session control units (GTP-C/s), each being set to 
controlling a plurality of data sessions for Mobile Stations (MSs); 

a plurality of data sessions payload units (GTP-Us) for supporting a 
routing of a payload of the data sessions; and 

a master data session control unit (GTP-C/m) detecting a failure or a 
shutdown of one of the GTP-C/s of the GGSN, the GTP-C/m further detecting if 
the failed GTP-C/s controlled any data sessions before it failed, and if the failed 
GTP-C/s controlled any data sessions before it failed, the GTP-C/m requesting 
from the plurality of GTP-Us to close all the data sessions; 

wherein the GTP-Us respond to the request by closing all accounting 
sessions related to the data sessions. 

In yet another aspect, the present invention is a Gateway General Packet 
Radio Service (GPRS) Support Node (GGSN), comprising: 

a master data session control unit (GTP-C/m); 

a plurality of data session control units (GTP-Cs); and 

a Routing Engine (RE) detecting a failure or a shutdown of the GTP-C/m; 
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wherein the RE in combination with all remaining GTP-Cs available in the 
GGSN further detect the GTP-C with the least load, and elect the GTP-C with the 
least load as a fail-over unit for the GTP-C/m that failed, and wherein the elected 
GTP-C recovers information related to the failed GTP-C/m from the remaining 
GTP-C units, rebuilds a GTP-C/m information database using the information 
related to the failed GTP-C/m, and starts acting as a GTP-C/m of the GGSN. 

Brief Description of the Drawings 

For a more detailed understanding of the invention, for further objects and 
advantages thereof, reference can now be made to the following description, taken 
in conjunction with the accompanying drawings, in which: 

Figure 1 (Prior Art) is a high-level logical architecture diagram of a typical 
GPRS network as it is known in the prior art; 

Figure 2 is an exemplary nodal architecture diagram of a Gateway GPRS 
Support Node (GGSN) according to the preferred embodiment of the invention; 

Figure 3 is an exemplary nodal operation and signal flow diagram of one 
aspect of the preferred embodiment of the invention; 

Figure 4 is another exemplary nodal operation and signal flow diagram of 
another aspect of the preferred embodiment of the invention; and 

Figure 5 is yet another exemplary nodal operation and signal flow diagram 
of yet another aspect of the preferred embodiment of the invention. 
Detailed Description of the Preferred Embodiments 

The innovative teachmgs of the present invention will be described with 
particular reference to numerous exemplary embodiments. However, it should be 
understood that this class of embodiments provides only a few examples of the 
many advantageous uses of the innovative teachings of the invention. In general, 
statements made in the specification of the present appUcation do not necessarily 
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limit any of the various claimed aspects of the present invention. Moreover, some 
statements may apply to some inventive features but not to others. In the 
drawings, like or similar elements are designated with identical reference 
numerals throughout the several views, and the various elements depicted are not 
necessarily drawn to scale. 

Referring now to Figure 2, depicted therem is an exemplary nodal 
architecture diagram of a Gateway GPRS Support Node (GGSN) 200 according 
to the preferred embodiment of the invention. The GGSN 200 comprises a 
distributed GGSN control plane functionality (GTP-C) 202 having multiple 
control processing units (GTP-Cs) 204-210 for communication sessions control 
handling. Preferably, the GTP-Cs are processing cards that control one or more 
Point-to-Point Protocol (PPP) data sessions for mobile terminals. Their main 
functions include charging (billing), processing the create GPRS Tunnelling 
Protocol (GTP) control messages related to each data session they control, and 
providing a Remote Authentication Dial-In User Server/Service (RADIUS) 
interface for user authentication. The GGSN 200 further comprises multiple 
communications (data session) payload processing units (GTP-Us) 212-216 which 
functions include handling the data sessions payload and of the GTP tunnelling 
and de-tunnelling for each data session they handle. The distributed GGSN 
control plane functionality (GTP-C) 202 of the GGSN 200 may also comprise a 
spare, non-utilized, GTP-C unit 211 that runs in a stand-by mode and is ready for 
taking over the control tasks of a failed GTP-C unit. This distributed architecture 
provides reUability and scalabiUty to the GGSN 200, and hence reduces the 
service downtime in case of a single point of failure in one of the GTP-Cs. The 
GGSN 200 fiirther includes a back-plane 220 acting as a communications bus 
connecting the different components of the GGSN 200. A Routing Engine (RE) 
222 is responsible for managing a routing table (not shown) allowing the correct 
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internal signalling and communications between the different components of the 
GGSN 200. Communications interfaces VF 224 and 226 provide access for the 
GGSN 200 to external networks 228 selected by the users, or to cooperating 
GGSNs. 

5 According to the present invention, the GGSN 200 provides support for 

load balancing and control task distribution between the active GTP-Cs, as it also 
provides support for load balancing and data sessions distribution between the 
H active GTP-Us. A centralized PDP context management for the whole GGSN 

O control plane offers an efficient method for load balancing and redundancy. 

j| 10 Accordingly, all primary PDP contexts create requests are addressed to a master 

H GTP-C unit (GTP-C/m) 204, which thereafter dynamically dispatches the request 

y messages to other slave GTP-Cs (GTP-C/s) 206-210. Subsequent conmiunications 

f for the same link (Primary PDP context and associated secondary PDP context) 

between a served Mobile Station (MS) and the GGSN 200 are directly addressed 

res ^ 

^ 15 to the appropriate GTP-C/s by utilising a GGSN address for control plane 

O information element in the GTP create response message, formatted for example 

according to the Third Generation Partnership Project (3GPP) Technical 
Specification (TS) 29.060/GSM 09.060, herein included by reference. 

The GTP-C/m and GTP-C/s can use broadcast, multicast messages or 
2 0 similar mechanism to exchange information with each other and between the unit 
boards for the support of load balancing and GTP-C redundancy. According to 
the invention, the heartbeat message exchange may have two sets of information 
with different urgency. First a keep-alive information is used to update 
cooperating units within less then, for example, 100 milliseconds at both 
25 hardware or software failure. The keep-alive information is used to detect 
addition, removal and failure on the boards of the node. Second, load information 
may be updated with a frequency of every more or less 1 second to distribute load 
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information from the GTP-C/s and GTP-Us, For efficiency purposes, according to 
the invention, the keep ahve message exchange may be handled on low software 
level (kernel) in each board and may only be reported to a higher level 
supervision function (not shown), for actions, at an addition, removal and/or 
5 failure situation in the other parts of the node. The load information, reported wi± 
less frequency includes relevant load information for the processor units, is 
periodically distributed between all the GTP-C/s 216-210 and also to the GTP- 
C/m 204 to indicate their current individual load. The GTP-C/m 204 and each 
GTP-C/s 206-210 keep the load information from other GTP-C/s locally. The 
10 GTP-C/m 204 also keeps the load information from the GTP-Us 212-216. For 
example, the local load information may contain at least the following fields per 
processor unit: 

1. GTP-C/s Identifier (BP address or GTP-C other ID internally used to uniquely 

identify aboard); 

15 2. Current number of active PDP contexts and/or CPU utilisation (memory 
utilisation, average present queue length, average present CPU load); 

3. Expected maximum capacity or hardware version number; 

4. Unit Restart and rebuild information; 

The GTP-C/m stores a minimum set of information related to the PDP 
20 context in such a way that the GTP-C/s information can be re-build in 
combination with the information stored on the GTP-U, when such a GTP-C/s 
unit fails, in a manner yet to be described. 

Reference is now made to Figure 3, wherein there is shown an exemplary 
nodal operation and signal flow diagram of one aspect of the preferred 
25 embodiment of the invention directed to a recovery scheme of a failed GTP-C/s 
(slave) unit of the GGSN 200 that has a spare, un-utilized GTP-C. In Figure 3, the 
shown exemplary nodal operation and signal flow diagram illustrates the same 
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GGSN 200 having the same components as those described with reference to 
Figure 2. At the beginning, it is assumed that the GGSN 200 functions normally, 
wherein each GTP-C/s control one or more data communications sessions, which 
payload is processed by a corresponding GTP-U. At one point in time, one of the 
5 GTP-C/s, such as for example the GTP-C/s (slave 2) 208 experiences a failure, or 
for a given reason is shut down by the operator, action 300. Following the failure, 
via the heartbeat (keep-alive) signal sent by the other GTP-C units, or because of 
the lack of heartbeat signal (keep-aUve) sent by the failed GTP-C 208, the 
Routing Engine (RE) 222 is informed of the failure or shutdown of the GTP-C 

10 208, action 302, which in turn informs the GTP-C/m (master) unit 204, action 
304. Since the GTP-C/m comprises a list of all active PDP contexts of the GGSN 
200, in action 306, it may detect whether or not the failed GTP-C 208 was 
controlling any active data communications sessions by detecting if the given 
GTP C contained any PDP context information. If so, in action 308, the GTP-C/m 

15 sends to all GTP-Us 212 and 214 a Close Sessions message with a parameter 
having the identity of the failed GTP-C/s 208, thus instructing all GTP-Us to close 
all data communications sessions that were previously controlled by the GTP-C/s 
208 that failed. In actions 310, the GTP-Us 212 and 214 close the data 
communications sessions previously controlled by the GTP-C 208 that failed, and 

20 acknowledge completion of this fact by sending a Close Sessions 
Acknowledgement message to GTP-C/m 204, actions 312. The GTP-C/m 204 
then signals the RE 222 with a Delete Route message 314 requesting the deletion 
from the routing table (not shown) of the routes related to the data sessions closed 
in action 310, which the RE 222 does in action 316. The GTP-C/m 204 further 

25 closes the accounting sessions related to the data communications sessions which 
control was held by the failed GTP-C/s 208, action 318, and further reports this 
fact to the RE 222, action 320. 
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The GGSN 200 comprises a spare, non-utilized, GTP-C unit 209, that is 
run in stand-by mode (ready to be used) and that is identified by the GTP-C/m 
204 as a spare GTP-C. In action 322, the GTP-Om 204 detects, or may be 
otherwise informed of the presence of the GTP-C spare 209, and further performs 
5 an activation of the GTP-C spare 209, action 324, by sending a Role Assignment 
message to the GTP-C spare 209, the message comprising the new role for the 
GTP-C spare (role = GTP-C/s slave) and the new IP address assigned to the GTP- 
C, which is the same that the one of the failed GTP-C/s 208. Therefore, the GTP- 
C spare 209 is set-up as a regular slave GTP-C/s unit by allocating it the JP- 

10 address of the failed GTP-Qs 209. In action 328, the newly set up GTP-C/s 209 
starts functioning as an active GTP-C/s unit. FinaUy, the new GTP-C/s 209 send 
to the GTP-C/m 204 an Activation Done message 330, and the GTP-C/m 204 
sends a Recovery Complete message 332 to the RE 222 for informing of the 
completion of the set-up of the spare GTP-C as a GTP-C/s. 

15 Based upon the foregoing, it should now be apparent to those of ordinary 

skill in the art that the present invention provides an advantageous solution, which 
offers GTP-C/s unit redundancy, by quickly activating a spare, non-utilized, GTP- 
C unit in instances of failure or shutdown of an active GTP-C/s unit. Further, the 
present invention provides an advantageous scheme wherein most of the data 

2 0 communications sessions held by the plurality of GTP-C/s units of the GGSN 200 
are kept alive in case of a single point of failure of one of the GTP-C/s units, and 
wherein only those data communications sessions controlled by the failed GTP- 
C/s are lost. 

Reference is now made to Figure 4, wherein there is shown an exemplary 
25 nodal operation and signal flow diagram of another aspect of the preferred 
embodiment of the invention durected to a recovery scheme following the failure 
of the GTP-C/m 204 of the GGSN 200 that has a spare, un-utilized GTP-C 209. In 
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Figure 4, the shown exemplary nodal operation and signal flow diagram illustrates 
the same GGSN 200 having the same components as those described with 
reference to Figure 2 and 3. At the beginning, it is assumed that the GGSN 200 
functions normally by supporting a number of data communications sessions, as 
described hereinbefore. At one point in time, the GTP-C/m (master) unit 204 
experiences a failure, or for a given reason is shut down by the operator, action 
400. Following the failure or shutdown 400, via the heartbeat (keep-alive) signal 
sent by the other GTP-C units, or because of the lack of heartbeat signal (keep- 
alive) sent by the failed GTP-C/m 204, the RE 222 is informed of the failure or 
shutdown of the GTP-C 208, action 402. In action 404, the RE 222 informs aU the 
GTP-C units 206, 208, and 209, that the GTP-C/m 204 is down, and in action 406, 
the GTP-C with the least load among all available GTP-C units is detected. In the 
present case, the GTP-C spare 209 is the GTP-C with the least load among all 
available GTP-C units, since it held no active PDP context information. 
Following the election of the GTP-C spare 209 as the least loaded GTP-C unit, 
and by consequence its election as a fail-over unit, the GTP-C spare 209 sends a 
Route Update message 407 for requesting the RE to update the routing table (not 
shown) in order to reflect the fact that the GTP-C/s spare is from now on acting as 
a GTP-C/m. Then, the GTP-C spare 209 sends a GTP-Qm Recovery Request 
message 408 to all remaining active GTP-C/s 206 and 208, in order to acquire 
from them all pertinent information that was originally stored in the GTP-C/m 
204 that is now failed. Responsive to the request 408, the GTP-C spare 209 
receives from each active GTP-C/s a GTP-C/m Recovery Information 410 
comprising information related to the identification and control of the data 
sessions handled by each GTP-C/s, such as for example, but not limited to the 
Access Point Name (APN), tiie GTP-U identification of tiie GTP-U tiiat processes 
the payload of each session, etc. Each one of tiie GTP-C/s 206 and 208 then 
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confirm the end of the transmission of the GTP-C/m Recovery Information by a 
GTP-C/m Recovery Completed message 412. Having received the appropriate 
GTP-C/m Recovery Information, the GTP-C spare 209 rebuilds the GTP-C/m 
information database in action 414, and starts acting as a GTP-C/m (master) unit, 
action 416. Finally, the newly rebuild GTP-C/m 209 sends a Recovery Complete 
message 418 to the RE 222 for informing of the completion of the rebuild 
process. 

Based upon the foregoing, it should now be apparent to those of ordinary 
skill in the art that the present invention provides an advantageous solution, which 
offers GTP-C/m redundancy, by quickly activating a spare, non-utilized, GTP-C 
unit as an active GTP-C/m (master) unit in instances of failure or shutdown of the 
active GTP-C/m. Further, the present invention provides an advantageous scheme 
wherein all the data communications sessions held by the GGSN 200 are kept 
alive in case of a single point of failure of the GTP-C/m. 

Reference is now made to Figure 5, wherein there is shown an exemplary^ 
nodal operation and signal flow diagram of yet another aspect of the preferred 
embodiment of the invention directed to a recovery scheme following the failure 
of the GTP-C/m 204 of the GGSN 200 wherein there is no spare GTP-C unit 
available in the GGSN. In Figure 4, the shown exemplary nodal operation and 
signal flow diagram illustrates the same GGSN 200 having the same components 
as those described with reference to Figure 2 and 3, except for the GTP-C spare. 
At ttie beginning, it is assumed that the GGSN 200 functions normally by 
supporting a number of data communications sessions, as described hereinbefore. 
At one point in time, the GTP-C/m 204 experiences a failure, or for a given 
reason is shut down by the operator, action 400. Following the failure or 
shutdown, via the heartbeat (keep-alive) signal sent by the other GTP-C units, or 
because of the lack of heartbeat signal (keep-alive) sent by the failed GTP-C/m 
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204, the RE 222 is informed of the failure or shutdown of the GTP-C 208, action 
402. In action 404, the RE 222 informs all the GTP-C units 206 and 208 of the 
GGSN 200, that the GTP-am (master) 204 is down, and in action 407, the GTP- 
C/s with the least load is detected, which in the present case is assumed to be the 
GTP-C/s (slave2) 208. FoUowing the election of the GTP-C/s 208 as the least 
loaded GTP-C, and by consequence its election as a fail-over unit, the GTP-C/s 
208 closes all the current data communications sessions related to its active PDP 
contexts, action 500, and therefore ceases to control data sessions and act as a 
slave GTP-as. Therefore, in action 504, the GTP-C 208 sends a Route Update 
message to the RE 222 to request the closure of its routes associated with the 
closed PDP contexts. The GTP-C 208 further transmits a GTP-C/m Recovery 
Request message 508 to all active GTP-C/s (in the present illustrated exemplary 
scenario only to GTP-C/s 206), in order to acquire all pertinent information that 
was originally stored in the GTP-C/m (master) 204 that failed. Responsive to the 
request 508, the GTP-C/s 208 receives from GTP-C/s 206 a GTP-C/m Recovery 
Information 510 comprising mformation related to the identification and control 
of the data sessions handled by each GTP-C/s, such as for example, but not 
limited to the Access Point Name (APN), the GTP-U identification of the GTP-U 
that processes the payload of each session, etc. The GTP-Os 206 confurms the 
end of the transmission of the GTP-C/m Recovery Information by a GTP-Qm 
Recovery Completed message 512. Having received the appropriate GTP-C/m 
Recovery hiformation, the GTP-C/s 206 rebuilds the GTP-C/m (master) 
information database in action 514, and starts acting as a GTP-C/m (master), 
action 516. FinaUy, the newly rebuild GTP-Om 208 sends a Recovery Complete 
message 518 to the RE 222 for informing of the completion of the rebuild 
process. 
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Based upon the foregoing, it should now be apparent to those of ordinary 
skill in the art that the present invention provides an advantageous solution, which 
offers GTP-C/m redundancy, by quickly activating a less important GTP-C/s 
(slave) mat as an active GTP-C/m (master) unit in instances of failure or 
shutdown of the active GTP-C/m unit. Further, the present invention provides an 
advantageous scheme wherein most of the data communications sessions held by 
the plurality of GTP-C/s units of the GGSN 200 are kept alive in case of a single 
point of failure of the GTP-C/m unit even when no spare GTP-C unit is available, 
by scarifjing only the least loaded GTP-C/s unit in order to recover the GTP-C/m 
unit, wherein only those data communications sessions controlled by the least 
loaded, sacrificed GTP-C/s unit are lost. 

Although the system and method of the present invention have been 
described m particular reference to certain radio telecommunications messaging 
standards, it should be realized upon reference hereto that the innovative 
teachings contained herein are not necessarily limited thereto and may be 
implemented advantageously with any applicable radio telecommunications 
standard. It is believed that the operation and construction of the present invention 
will be apparent from the foregoing description. The method and system shown 
and described have are provided as exemplary embodiments of the invention, it 
will be readily apparent that various changes and modifications could be made 
therein without departing from the scope of the invention as defined by the claims 
set forth hereinbelow. For example, while the invention has been described with a 
given of GTP-C/s units and GTP-U units, it is understood that this number may 
vary according to the needs of a GGSN given implementation. 

Although several preferred embodiments of the method and system of the 
present invention have been illustrated in the accompanying Drawings and 
described in the foregoing Detailed Description, it will be understood that the 
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invention is not limited to the embodiments disclosed, but is capable of numerous 
rearrangements, modifications and substitutions without departing from the spirit 
of the invention as set forth and defined by the following claims. 
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